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The Law of the Iterated Logarithm for some Markov operators, which converge exponen¬ 
tially to the invariant measure, is established. The operators correspond to iterated function 
systems which, for example, may be used to generalize the cell cycle model examined by 121. 


INTRODUCTION 


We consider some Markov operators acting on Borel measures defined on Polish spaces and 
corresponding to iterated function systems, which may describe e.g. the process of cell division. 

One of the hrst cell cycle models was proposed in 1988 by J.J. Tyson and K.B. Hannsgen Q, 
while the full description of the research was given by A. Murray and T. Hunt Q. In 1999 
an interesting result was published by A. Lasota and M.C. Mackey 1^. Their research was further 
developed by S. Hille and co-authors who proposed the generalisation of the model considered in 12| 
and analyzed it in terms of its ergodic properties (see Q|, jl^l. i.e. the existence of an invariant 
measure was established in Q], while asymptotic stability, exponential rate of convergence to the 

unique invariant measure in the Fourtet-Mourier norm and the Central Limit Theorem (CLT) were 

□ 

proven in |10l |. 

The aim of this paper is to verify the Law of the Iterated Logarithm (LIL), which completes 
the ergodic description of the generalised cell cycle model. Note that the results obtained in [l^ . 
i.e. the exponential rate of convergence (see Theorem 1, jl^L are necessary to prove the LIL. 
Moreover, the variance of the normal distribution present in the thesis of the CTG (see Theorem 2, 
l(i| ) is consistent with the one given in the main theorem of this paper - Theorem 2 (see Remark 
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1 and the proof below). 

The functional form of LIL, known now as the Strassen invariant principle, was defined by 
V. Strassen in 1964 [l7|. The results for martingales were further investigated in many papers (see 
e.g. 01, 01 or (i0i. To obtain the LIL for a wider class of stochastic processes (i.e. for Markov 
processes with spectral gap in the Wasserstein metric) the martingale method due to C.C. Heyde 
and D.J. Scott (Theorem 1, S) was used and combined with the Birkhoff individual ergodic theorem 


(see 


0 or 13). 


In this paper, however, the key role is played by the coupling measure whose construction is 


motivated by M. Hairer 0. M. Hairer proposed to build the coupling measure on the whole trajec¬ 
tories and use it to prove the exponential rate of convergence for some class of Markov operators 


we have observed 


(coupling measure is constructed in the same manner e.g. in j3| or Q)- In Q 
that such a coupling measure is extremely useful in the proof of the CLT. This paper shows that, 
in addition, it is significant to verify the LIL (see Theorem 2). 

The greatest difficulty was to prove that relevant functions are continuous. Some properties of 
the carefully constructed coupling measure appeared to be important in overcoming this difficulty. 

The organisation of the paper goes as follows. Section 2 introduces basic notations and defini¬ 
tions. Most of them are adapted from 0 , 0, Q, Q or j3|- Assumptions and properties of the 


model are stated in Section 3. We do not repeat neither the construction of the coupling measure 
(described in details in Sections 5-7, |lfll|). nor the proofs given in |lfl| . We restrict ourselves to re¬ 
calling these facts which are necessary to prove the LIL. In the last section we finally give a detailed 
proof of the LIL. 


II. NOTATION AND BASIC DEFINITIONS 

Let (X, q) be a Polish space. We denote by Bx the family of all Borel subsets of X. Let B{X) 
be the space of all bounded and measurable functions f : X ^ R with the supremum norm and 
write C{X) for its subspace of all bounded and continuous functions with the supremum norm. 
Additionally, we consider the space B{X) of functions f : X ^ R which are measurable and 
bounded from below. 

We denote by M{X) the family of all Borel measures on X and by Mjj„(X) and Mi{X) its 
subfamilies such that ^i{X) < oo and ^{X) = 1, respectively. Elements of Mfin{X) which satisfy 
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n{X) < 1 are called sub-probability measures. To simplify notation, we write 

f{x)^i{dx) for f : X ^ R, n e M{X). 

Jx 

An operator P : Mfin{X) —>• Mfin{X) is called a Markov operator if 

1. P(Ai/ii + A 2 /r 2 ) = AiP/ri + A 2 T’/r 2 for Ai, A 2 > 0, /r 2 G 

2. P^l{X) = fi{X) for fr e Mfin{X). 

Markov operator P for which there exists a linear operator U : B{X) —?■ B[X) such that 

{Uf, /i) = if, Pp.) for / G B{X), G 

is called a regular operator. Operator U : B{X) —)• B{X) is then called a dual operator for 
P and it can be easily extended to B{X). We say that a regular Markov operator is Feller if 
U{C{X)) C C{X). Every Markov operator P may be extended to the space of signed measures on 
X denoted by Msig{X) = {/.ii — ^2 ■ G By || • || we denote the total variation 

norm in Msig{X), i.e. 

||/i|| = ii+{X) + 11 -{X) for G Msig{X), 

where fi^ and come from the Hahn-Jordan decomposition of fi (see [3|). In particular, if fi is 
non-negative, ||^|| is the total mass of For fixed x G X, let us introduce the function Qx '■ X ^ R 
describing the distance from the point x , i.e. Qx{x) = q{x,x) for x G X . For hxed x G X and 
r > 0, we also consider the space M[{X) of all probability measures with hnite r-th moment, i.e., 
M[(X) = {/r G Mi{X) : g%{x)fi{dx) < 00}. The family is independent of choice of x G X. We 

call /r* G Mfin{X) an invariant measure of P if P/r* = /r*. We dehne the support of /r G Mfin{X) 
by 

supp /i = {x G X : fi{B{x,r)) > 0 for all r > 0}, 

where B{x,r) is an open ball in X with center at x G X and radius r > 0. By B{x,r) we denote 
a closed ball with center at x G X and radius r > 0. 

In Msig{X), we introduce the Fortet-Mourier norm 

llAtIk = sup|(/,/r)|, 
f&c 

where £ = {/ G C{X) : |/(x) - f{y 
metric ||/ri — fi2\\c is complete (see ( 


I < n( x,?/b I flxfl < I for x,y G X}. The space Mi(X) with 

I, m or Ml). 
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III. ASSUMPTIONS AND PROPERTIES OF THE MODEL 

A. Assumptions 


Let iL be a separable Banach space. We may think of a closed subset of Lf as a Polish space 
{X,q), where the distance p is induced by the norm in H. We also condider a probability space 
(n, Prob). Let e* < oo be given. We fix e £ [0,e*] and T < oo. We consider a stochastically 
perturbed dynamical system of the form 

Xn+l = S{Xn,tn+l) + L^n+1 for n > 0, 

where {Hn)n>i is a family of independent random vectors with values in H and with the same 
distribution which is independent of S{xn,tn+i) and its support stays in i?(0,e). We make the 
following assumptions. 


(I) We consider a sequence (tn)n>i of independent random variables defined on (0, X, Prob) with 
values in [0,T]. Distribution of tn+i conditional on Xn = x is given by 

rt 


Proh{tn+l < t\Xn = x) = / p{x,u)du, 0<t 

Jo 




where p : X x [0,T] ^ [0, oo) is a measurable and non-negative function. In addition, p is 
normalized, i.e. p{x, u)du = 1 for x £ A. 

(II) Let S' : A X [0, T] ^ A be a continuous function which satisfies the Lipschitz type inequality 
p(S(x,t),S(y,t)) < X{x,t)g{x,y) for x,y £ X,t £ [0,T], 
where A : A X [0, T] —>• [0,oo) is a Borel measurable function such that 


a 2 +s ■= sup / {x,t)p{x,t)dt < 1. 

xgx Jo 

Note that, due to the Holder inequality, we also know that 

rT ,, , pT 


( 1 ) 


ai : = 


pi pi 

:= sup / X{x,t)p{x,t)dt < < 1, 02 := sup / X^{x,t)p{x,t)dt < < 1- 

x&X Jo x&X Jo 


(III) We require supjgjQ j’] Qx(^S{x,t)^ < 00 for some x £ A and so we can set 


c := sup px(S(x, t))-h e* < 00 . 

tG[o,r] 


( 2 ) 


5 




(IV) We assume that p satisfies the Dini condition 

10 

where the function cj : ii+ —i?+ is non-decreasing, concave and such that w(0) = 0, as well as 

uj{t) 


[ \p{x, t) - p{y, t)\dt < uj{q{x, y)) for x, y 
Jo 


f 


t 


-dt < +00 for some u > 0. 


We can easily check that if ^ < 1, we have 

CX) 

p{t) = E < - 1-00 for every t > 0. 


n=l 


Moreover, limt_>.o ip{t) = 0. 

(V) Function p is bounded. We set Mi := 'mi^^x,te(o,T]Pix,t), M 2 ;= sup^^x,te[o,T]Pix,t) and 
require Mi > 0. 

(VI) Let be a Borel measure on H such that its support is in B{0,e). We set 

^x(') = “ x) for every x G X. 

We assume that S{x,t) + h G X for every t G [0,T], x G X and h from the support of 


The Markov chain is generated by the transition function : X x Bx —)• [0,1] of the form 

U^ix,A):=j^ p{x,t)’^l(^^^t)i^)dt. 

Note that the function !!£(•, M) : X ^ R is measurable for fixed A G Bx and I\.^{x, ■) : Bx —>• [0,1] 
is a probability measure for x G X. Hence, there exists a unique regular Markov operator : 
Mi{X) —)• Mi{X) which is defined as follows 

Pep{A) := [ Il^{x,A)fi{dx) 

Jx 

and its dual operator '■ Bx —^ Bx is given by 


(see Section 1.1, 



Uef{x) := [ f{z)Il^{x,dz) 
Jx 
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B. Properties of the model 

Let us introduce an auxiliary model. If we fix a sequence of constants (hn )n>i C H,hn£ 
and introduce functions Th.{x,t) := S{x,t) +hi, i> 1, we may consider a stochastically perturbed 
dynamical system 


Xn+l — ^n+l) •— '5(®n)^n+l) f^n+1 fo^^ 72 ^ 0. 


Further, we define one-dimensional distributions 


nO(x,A) = 4(A) 


rj-i 

'Bi,{x,A)=[ lA{Thi{x,t))p{x,t)dt 
Jo 


( 3 ) 


Ill,...,,Jx,A)= / Ul{y,A)Ul;^ ,^Jx,dy), 

J X 

where A G Bx and 5x is a Dirac measure at x G X. We easily obtain multidimensional distributions. 
Let X G X and n > 0. If we assume that LlJ^’"'’"'^ (x, •) is a measure on X’^, generated by a sequence 
(n^ (x, then we can define the measure •) on as the only measure which 

satisfies the condition 


hi.,hn-j-l 


(x, A X B) 


n 


(Zn, B)nl’^''’y^(x, dz) for z = (zi,.. .,Zn}, A G Bx’-, B G Bx- 


'n + 1 


( 4 ) 


Finally, we obtain a family {11“ (x, •) : x G X} of measures on X°°. Note that the measures 

n^^(x,-),..., (x, •), given by ([3]) , are marginal distributions of 11^ • The existence 

of measure 11“ (x, •) is established by the Kolmogorov theorem. More precisely, for every x G X, 

there exists some probability space on which we can dehne a stochastic process with distribution 
such that 


(j)^=o{B) = Probdw G n : TM G B}) = .B) for B G Bx--. 

Therefore, 11^ (x, •) is the distribution of the non-homogeneous Markov chain on X“ with 

sequence of transition probability functions (nd)iGA'' and = 6x- This construction was adapted 
from Q|. 

Note that, for every n G N and arbitrary A G Bx, LI^^ f^^{-,A) : X ^ R is measurable by 
definition. Furthermore, IIJJ^ ^^(x,-) is a probability measure for x G X. Again, thanks to these 
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properties (see Section 1.1, 


23| ), there exists a unique regular Markov operator , for which 


n 




is a transition probability function, and it is given by the formula 


= f forMGilx, 

J X 

Moreover, its dual operator is defined as follows 

{UJ:,...,hJ){x)= [ f{y)Ul_^Jx,dy) for f e B{X). 

n "" 

We refer the reader to [10|, where a lot of useful properties of PJ^_^ was established. Firstly, 
PJ^^ ^ is a Feller operator (see Remark 1, {l^ ). Secondly, if ^ G M|(X), then also 
M\{X) for i G {1, 2}, which is proven in Lemmas 1 and 5 (see [l0|). All estimates in proofs of these 
lemmas are independent of {hn)n>i- This is crucial, because it makes all the facts valid for P", 
which follows from the relation 

PeK-)=[ [ ■■■ [ ^hi,...,hAxr)^^dhi) ...i^^{dhn)y{dx). (5) 

Hence, P^ has the Feller property and, if /i G M[{X), then also P^y, G M[{X) for i G {1,2}. 
Moreover, the dual operator [/” to P" is of the form 

{U^f){x)= [ ...[ [ f{y)Ul_^Jx,dy)u%dhi)...u%dhn) for / G P(A) 

Jb{0,s) JB{0,e) Jx 

and it may be extended to BiX). 

□ n 

In Section 7 of [lOj we adapt the construction introduced in and, for some fixed XQ,yQ G X 
and initial distribution (J(xo,j/o,i)’ build an appropriate coupling measure ((xq, yo, 1),') 

on (X^ X {0,1})°°, which has the following properties 

(a) n*^,)^C'-^ ((xo,2/0,1),-) = C-;,^„„((^o,2/o),-), where : (A^xlO,!})- ^ (X^)- 

is the projection on (A^)°°, 


(b) C,-,^,...((xo,2/o),^ X X) = .(xo,A) and C,-,^_...((^o, 2 /o), ^ x B) = (j/o, P) 

for A,B£ <8)“iPx, 

(c) the marginals 2/o),') of ((^o,2/o),-) are coupling measures on X^, i.e. 

they couple measures _^^(xo,-), ^^^(//o, •), given by 

(d) marginal coupling measures are related by the condition 

<^hi,...,h„((®o, 2 /o),-) = f C^„((^i,Z2),-)C'fe“l.,/*„_i((a;o,2/o),c?2i X dz2), ( 6 ) 

J X 

which follows from the construction of the coupling measure on the whole trajectories (see 
Section 7, [l^l. 
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Let g G B{X) be a Lipschitz continuous function with constant Lg > 0. Then, it follows from 
Lemma 4 and Remark 2 |lfl| that there exist q G (0,1) and C > 0 such that 

[ \9{u) - g{v)\{U*^ 2 U^C^ h 2 _{{x,y,l),-)){du x dv) < + g^ix) + Qx{y)),x,y GX,nG N, 

Jx^ 

(7) 

where 11* : (X"^ x {0,1})°° —>• X'^ x {0,1} is the projection on the n-th component, Lt^j : x 

{0,1} —)■ X^ is the projection on X^ and G := maxjLg,sup^;^^ | 5 (a:)|}. The above inequality is 
crucial in the proofs of the exponential rate of convergence and the CLT (see Theorems 1 and 2, 10l|L 
Let us introduce some additional notation. Let {xn)n>o be a Markov chain. For a given proba¬ 
bility measure /r G and a Borel event B G ®'^iBx, we write 

Prob^(i?) := / Prob((xo, xi,...) G i?|xo = x)/i(dx). 

Jx 

Moreover, 

Prob^(xo G Ao,xi G Ai, ... ,Xn G An) 

— I I ' I ble('5n—1) ^n)Ll£:(Sfi—i, . . . Ilf,( sq, d'Si)/i((iso) 

J Aq J Ai J A„-i 

for n > 0 and ^Oj ■ ■ ■ j An G Bx (compare with Theorem 3.4.1, (l^L 
denoted by Eg. For g, = 6x, we just write Proba, and Ex- 


The respective expectation is 


Lemma 1. Let ai, 02 , 0 , 2+6 given as in Assumption (II) and let c be given as in Assumption (III). 
If g G {X), then also Pfg G m((X) for n > 1 and j G {1, 2, 2 + 5}, i.e. 


sup Eg (giixn) ^ 

) = sup / 

n>0 ^ ^ 

n>0 Jx 


which in stationary case means that G L^{g^) for j G {1,2, 2 -|- 5}. 
Proof. Let g G M( (X) for j G {1, 2, 2 -|- 5} and let h G B{0,s). Note that 


e’x^Phh 


1/1 


e’x{y)Bh{x,dy)g{dx\ 


1/1 


'X JX 

gi(Th{x,t))p{x,t)dtg{dx)] < \\Qx oThWiog), 
X Jo J 



where || • is the norm in the space L^igf) such that ||/||i;,j(,j) = \{f^x)\^^^ foi / G B{X x [0,T]) 
and ? G Mfin{X x [0,r]) given by ?(A) := /j^x[o,T] '^A{{x,f))p{x,f) dt g{dx) for A G Bx ® 

By Assumptions (I) and (II) we obtain 


{Qx o Th){x,t) = g{Th{x,t),x) < g{Th{x,t),Th{x,t)) + g{Th{x,t),x) < X{x,t)gx{x) + c 
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and therefore 



r 

i/i 


< 

/ {x,t)g^{x)p{x,t) dt fi{dx) 

+ c < 

aj (^gi,p^ 


Jxx[o,T] 



i/i 


+ c, 


which finally gives us 




<{a, 


3 

2/j 


J pn-l 


1/i 


+ C 




1/i 


+ c 1 + a 


i/i 


<...< laf^' 




Pci\-af 


i\ J 


where < 1, c < oo by assumption and the estimations are independent of (/ii)i>i. Hence, we 


obtain 


gi,PelJ-) < ( 


Qx'> M 




_i\ j 


< oo, 


which completes the proof. 


( 8 ) 

□ 


IV. THE LAW OF THE ITERATED LOGARITHM APPLIED TO MARKOV CHAINS 


A. A martingale result 

We begin with presenting a classical result established in js]. Let (M„)„>o, defined on 
Prob), be a martingale with respect to {J^n)n>0: where J'q = {f^,0} and is the cr-field 
generated by Mi,M 2 ,...,M„ for n > 0. We call {J-n)n>o the natural filtration of {Mn)n>o- Let 
us define {Zn)n>o such that Zq = Mq = 0 Prob-a.s. and Zn = Mn — Mn-i for n > 1. Further, let 
si := EM^ < oo. 

We consider the metric space (C, g) of all real-valued continuous functions on [0,1] with 

Q{fi,f 2 )= sup |/i(t) -/ 2 (t)| for/i,/ 2 £C. 

tG[0,l] 

Then, we define the set JC of all absolutely continuous functions / £ C such that /(O) = 0 and 
Jq if dt < 1. The real function F on [0, oo) is given by F{s) = sup{n : si < s}, while 
the sequence of real random functions (ryn)n>i on [0,1] is of the form 

^ Mfc + {sit - 4)(4+i - 4)~^^fc+i 

^24 log log 4 

for n > F{e), where l<A:<n — 1, s|< sit < We put r]n{t) = 0 for n < F{e). 
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Theorem 2 (Theorem 1, Q]). 7/s^ —>■ oo and the following conditions are fulfilled 


OO 


< OO for some 7 > 0 , 

n=l 

(9) 

00 

<00 foralMyO, 

n=l 

( 10 ) 

n 

s~^ —)• 1 Prob-a.s., as n ^ 00 , 

( 11 ) 


k=l 

then {'i]n)n>F{e) relatively compact in C and the set of its limit points coincides with JC. 


B. Application to the model 


We consider the model initially introduced in [9| and so Assumptions (I)-(VI) are fulfilled. Let 
us consider Markov chains {xn)n>o, {yn)n>o with state space X, transition probability function He 
and initial distributions G res pec tively. By we denote an invariant measure for 


the model, which exists due to Theorem 1 in 


lOfi. 


Further, let g £ B{X) be a Lipschitz function with constant Lg > 0. It is also assumed that 
id^h*) = 0 (otherwise we could consider g = g — (< 7 ,/r*)). 

Let n > 0. Note that by the Minkowski inequality in [Pfip) and Lemma [1] (precisely 

estimation ([ 8 ])), we obtain 

V(2+5) / r , _ n1/(2+5) 


l/(2+<5) 


< \g{x)\+Lg(^j^Ql+^{x)Pfi^i{dx)^ 

<\g{x)\+Lg[(^{Ql+\g)Y^ Vc(l- 
and consequently sup„>o ill/i ^|fl'(xn)P''''^^ < oo. Let x G X. By ([5|) we have 

OO OO 

\Uig{x)\ = - {9,P^h*)\ 


( 12 ) 


-1 


< oo 


i=0 


i=0 

oo 


(13) 


PB{0,e)y 
Further, due to d?]), we obtain 


\{9,Phi,...,hA) - {g,Pk,...,hil^*)W%dhi)... iy^{dhi). 


\{9,Phu...,hi^^) - (9,Pk,...,hi9'*)\< [ [ \9{u) - {{x,y,l),-)){du X dv) n^{dy) 

Jx Jx‘2 

< q^GC{l + Qx{x) + {Qx, g*)), 


(14) 
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where G := max{Lg, sup^-g^ | 5 '(x)|}. Comparing (fT3]l and ifHl) . we easily obtain 

OO 

\Ulg{x)\ < (1 - g')“^GC'(l + Qx{x) + {qx, /r*)) < oo (15) 

i=0 

and therefore we may define the function 


Xix) ■■= Ulg{x) for x e X. 


i=0 


(16) 


Lemma 3. Let us consider the function defined above. We have 

GC 

\x{x) - xiy)\ < -(1 + gs(x) + te(y)) for x,y G X. 

1- q 

Proof. Fix x,y G X. Following ([5]) and ([7]), we obtain 

Ix(a^) - x{y)\ 

oo oo oo 

= I y] Uigix) -^Ulgiy)\<^\ {g, - {g, P^Sy 

i=0 i=0 i=0 

oo « « 

= / \ 9 iV - 9 {x)\{'n*x 2 ll*Cf°^^f,^^..X{x,y,l),-)){du X dv) u%dhi).. 

J{B{o,e)Y Jx^ 




< qUC{l + Qx{x) + Qx{y)) = {l-q) ^GC{1 + Qxix) + Qxiy))- 

i=0 


□ 


Further, let us introduce random variables 

n—1 

XIn ■■= x{xn) - x(xo) + yy g{xi) for n > 0 

i=0 

and their square integrable differences which are of the form 


Zn = X{Xn) - X{Xn-l) + g{Xn-l) fom > 1 


and 


(17) 


(18) 


Zq = 0 Prob-a.s. 

Lemma 4. [Mn)n>o, defined by HI 71) . is a martingale on the space {X°°Proby) with 
respect to its natural filtration. 

Proof. Note that by the Markov property we have 


Ey {g{Xn+l)\Xn) (w) = (ff) = (Cs^)(w)) 


(19) 
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and therefore 


{Mn+l\En) = Ef, {x{Xn+l)\^n) “ Xixo) + '^g{Xi) 

i=0 

oo n 

= 'Y^Ue{Ulg){xn) -x{xo) + ^g{xi) 

2=0 2=0 

OO n—1 

= ^ Ulg{Xn) + U^g{Xn) - X{xo) + diXi) = Mr, 


2=1 


2=0 


□ 


Lemma 5. The square integrable differences {Zn)n>i, given by licgP . are such that E^^^Zl < oo. 

Proof. Let n > 1 and g. € Note that, by the Markov property (see (fT^ . we obtain 

^ui^n+i) = Epn^{Zl) = ((x(a;i) - x{xo) + g{xo)f |xo = x'j Pfg{dx) 

< [ E {2x^{xi)+ 2{x-gf{xo)\xo = x) Pfg{dx) 

Jx 

= [ 2E{x^{xi)\xo = x)+2{x-gf{x)Pfg{dx) 

Jx 

<2 [ {UeX^) {x)Pfg{dx)+ 4 [ x‘^ix)Pf g{dx) + 4 [ g^{x)Pfg{dx) 

Jx Jx Jx 

'[ x‘^{x)Pf"^^g{dx)+4 f x^{x)Pfg{dx)+4Eir{g{xn)f. 

Jx Jx 


= 2 


( 20 ) 


Following (ini), we easily obtain that the last component of (|20p is finite. Now, it is enough 
to establish that is finite. Note that. 


[ X^{x)Pfg{dx) = [ {{x{x) - x{x)) + x{x)f Pfg{dx) 
Jx Jx 


( 21 ) 


< 


2x^{x) +2 [ {x{x) - x{x)f Pfg{dx). 

Jx 

The first component of (f2T]) is finite due to (|15p and (llOp . To show finiteness of the second compo 
nent, let us refer to Lemma [3] to obtain 

2 f {x{x) - xix))‘^PeKdx) <2 [ (1 - q)-‘^G‘^C‘^{l + Qs:{x)f Pf g{dx) 

Jx Jx 

<4G^C\l-q)-^ (l + (,i,P»). 

Consequently, by (fT^ and (l20l) - (f22P we have 


Ep.^{zl) < c (1 + + {qIp») 


( 22 ) 
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and therefore, according to Lemma [U we obtain 

sn-pEpu^{Zl) <(7(1 + < oo. (23) 

n>0 

Now, we easily check that x i—>• Ex{Zf A A:) is a bounded countinuous function, for every A: > 1. 
Hence, we have lim„_^ooA A;) = E^j^^^Zf A k), as n —^ oo. By (f23)) . {E^^{Z‘l A A:))fc>i is 
bounded. As a consequence, if we apply the Monotone Convergence Theorem, we finally obtain 
limfc^oo -E'm. {Zl Ak) = E^^ {Zf) < oo. □ 

Set 


a^:=Ef,,Zl (24) 

Lemma 6. Let fi S If, for every n > 0, Mn is given by (fT71) and = E^M^ < oo, then 

s2 

lim — = cr^. 

n—>-cx) 77, 

Proof. Following the proof of Lemma [5] (inequalities (j2flp - ([23]) ). we obtain 

sup£’^|Z„p+^ < oo. (25) 

n>l 

Therefore, 

supF;^ (Z^l||^^|2>fc}) < supF;^ (\Zn\^^^{\Zn\‘^)~^^‘^l{\z^\2>k}) < k~^/^ supE^\Zn\^^^ 0 , 

as A; —)• oo. Now, since [Zf A k) are bounded continuous and is Feller, we obtain 

lim Epnn(Z? A k) = En^(Z? A k) for every A: > 1. 

Note that the sequence (F1^^(Z^ A k))k>i is bounded and therefore the Monotone Convergence 
Theorem implies 

lim Ef,^{Zf Ak) = E^^Zl = . 

k^oo 

Hence, we also have 


lim = lim Epn Zf = E^^Zf = a A 

n^oo n—!*-oo ^ 

Finally, by orthogonality of martingale differences, we obtain 


lim ^ = lim ElMI = lim 

n—>-cx) 77 n—>-cxD 77 n—^oo 77 


which completes the proof. 


□ 
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Remark 7. The variance a'^ = is compatible with the variance of limiting normal di¬ 
stribution in the CLT (see Theorem 2, Q/j, i.e. with 0-2 = ((5'*)^^, where S* = 

n-^/^{g{xo) + ... + g{xn-i)) for neN. 


Proof Note that 

lim ({Slf) = lim Ef,^ I n~^ ( '^gi 

n^oo \ / n^oo I \ ^ ^ 


^ 72—1 


Xi 


Ki=0 


= (n ^ {Mn + x(xo) - xixn))'^'^ (26) 

= lim E/,^ + lim 2n~^l'^E^^ (x(xo) - ^(a^n))) 

72—)-00 ^ ^ ^ 72^00 \ \ / / 

+ lim n~^Ef,^ (x(a;o) - xixn))‘^ ■ 

72—>-00 

Referring to Lemma [6l we have lim^^oo-E^, = E^^Z^. Further, due to Lemma [3] we 

obtain 

E^,, (x(a;o) - x{xn)f = [ [ ixiu) - X{v)f Pe K{dv)g^{du) 

Jx Jx 


< / / GC^{l-q) {1 +Qs,{u) + Qs,{v)) P25u{dv)g.^{du) 

JX Jx 

<Co [ / (1 + qI{u) + Ql{v))Pf'6u{dv)n^{du) 

Jx Jx 

<Co [ (l + qI{u) + {qI, P^du)) T*{du), 

Jx 


(27) 


where Cq is some constant. According to ([8]) we obtain 


Ef,, {x{xo) - x{xn)f <Co (l + qUu)) g^idu) < oo, 

Jx 


(28) 


where Cq is some positive constant. By the Holder inequality, we get 




n 


{x{xo) - x{Xn)) < {E^,, ixixo) - x{xn)f^ ^ < OO 


and therefore 


lim 2n ((n ^^Mn) {x{xo) - xixr 

72^00 \ \ / 

Summarizing the above estimates (|26p - (l2^ . we obtain 


= 0 . 


(29) 


72 —>-CX) \ f ^ 


which completes the proof. 


□ 
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Lemma 8. The square integrable martingale differences {Zn)n>i satisfy 

n 

— > Zj ^ a Probn-a.s., as n —)• oo, 
n 

1=1 

and consequently condition (ttH) holds for > 0. 


(30) 


Proof. The idea of the proof is based on the property of asymptotic stability of the model, as well 
as on the Birkhoff Individual Ergodic Theorem. 

The essence is to show that functions 


X Et 


X 


lim infri 


1 n 




limsup„^^ 


A I 


A I 


(31) 


l=i 


are not only bounded, which is obvious, but also continuous. Indeed, if continuity is provided, we 


use 


E„ 


the fact that Pffn converges weakly to /r*, as m —)• oo (see Theorem I, |lfl|). to obtain 


lim inf„^oo (-'^Zf] - 


n 


i=i 


A I) = j^E^ 


lim infr, 


n 


n 


i=i 


= / E, 
Jx 


.. n 1 

liminf„^oo(- ^ zfj - A l^PffyL{dx) ^ hminf„_^oo(- ^ Z\ 

^ 1=1 ^ 1=1 


^21 _ ^2 


A 1 


(32) 


Now, if we compare it with the Birkhoff Individual Ergodic Theorem, which says that 


lim inf r: 


1 

-Ez?)-..1ai)=o. 


1=1 


we may claim that 


E„ 


lim inf^^oo ( “ E ^ 


n 


1=1 


A 1 =0. 


This, in turn, impies 


lim inf r; 


1 

Prob^-a.s. 


1=1 


(33) 


Analogously, we may show that 

1 ^ 

limsup^^^f-j = o-^ Prob^-a.s. 


1=1 


(34) 


Finally, (f33]l and (IM|) imply (l30]l . 
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To complete the proof, continuity of both functions given by (|31ll should be established, just to 
make it clear that the convergence in (I32p occurs. Note that 

' j 


Er. 


liminf^^oo ( “ ^ 

\ n 


— a 


i=i 


A 1 = lim lim Ex 

I n —>-00 k^oo 


mm 




n<j<n-\-k \j j—^ 




A 1 


= lim lim Hn,k{x), 
n—>-oo k^oo 


where 




mm 

n<j<n-\-k \ J 


1 ^ 

lEA 




l = l 


A1 . 


(35) 


(36) 


Let us introduce 

'^n,kiyOj ■ ■ ■ 1 Vn+k) 


mm 

n<j<n-\-k 


j “ x(yi-i) + 9{yi-i)f A j (1 + (T^)^ - 


(37) 


Recalling the definition of martingale differences {Zn)n>i (see (I18h ) and following the property 


min ( ^ — b 

n<j<n+k Y j 


A 1 = 


min (-(c,-A 7(1 + 5)) — 5 I 
n<j<n+k Vj ' ^ J 


we obtain 


En,kix') — Ex (jpn,k (^0 j , • • • , Xn+k}) ■ (^^) 

The idea to express the functions in interest in terms of (|35p - (l38p comes from Q| or [ll|. However, 
the final step to show the continuity of functions is established thanks to the coupling measure. 

As mentioned at the beginning of the section {xn)n>o and {yn)n>o are Markov chains with trans¬ 
ition probability function Hg and initial distributions G respectively. In particular, 

we may set y := 5x and ly := 5y. For technical reasons, we also consider (xn)n>o and {yn)n>o, which 
are non-homogenous Markov chains with sequence of transition probability functions (njj.)i>i, given 
by Q, and initial distributions 6x and 6y, respectively. Note that, according to ([5|), we obtain 


PeSx{-)= [ Ul{x,-)l.^{dhi) 


and therefore. 


Exil{xQ,. . . ,Xn+k) = / Exil{xQ,. .. ,Xn+k) v^{dhi).. .^^{dhn+k)- 

£))"+'= 


( 39 ) 
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Let us remind the reader that there exists the appropriate coupling measure {{x,y),-) on 

(^2)00 g^g]^ ^j^at 

X ^) = and Q-y),X x B) = 

for every A,B £ as well as the coupling measure {{x,y, 1), •) on the augmented 

space X {0,1})°° (see Section 7 in (l^ for the full construction of coupling measures for iterated 
function systems). The expected value according to the measure i{x,y, 1), •) is denoted by 

^x,y 

Let us further introduce an auxiliary function 


^n,k{x) Ex {^n,k (®0; j ■ ■ ■ j ^n+fc)^ • 


(40) 


Then, 


lim lim 

n-^-cxD k^oo 


Hn,k{^) - Hn,k{y) = lim \Ex{lp{xo,...,Xn+k)) - Ey{'llj{yo,...,yn+k))\ 

n-i>oo fc^oo 

< lim lim Ex,y\'ip{xo,...,Xn+k)-ip{yo,---,yn+k)\- 

n —>-00 fc^oo 


(41) 


It is easy to see that 

m.™ ifji^j)) - m.™ ifjiVj)) < max \fi{xi) - fi{yi)\ 

l< 2 <n 

for arbitrary functions fi'.X^R and points Xi,yi £ X, 1 < i < n. We use this fact to obtain 


lim lim 

n —>-00 fc—>-oo 


Hn,k{x) Hn^kiy} 


< lim lim Ex y 1 max 

71—)-oo k^oo ’ \ n<i<n+k i 

\ — 1=1 


( ^ ^ ^ I 2 

inax , - Y] {x{xi) - X{xi-i) + g{xi_i)f A i{l + n^) 

\ 'nCn<C'nJ-h 7 7 ^ 


(42) 


- ixivi) - x{yi-i) + 9{vi-i)) A z(l + cr^) 


Note that the right side of (j^2)) is equal to 

/ Y ^ ^ I 2 

lim lim ^ max - (x(xz) - x(xz_i) + y(x/_i))^ A i(l + n^) 
n^ook^oo \ n<i<n-\-k I ^^ I 
\ l=kQ 


- ixim) - x{yi-i) + a{yi-i)f a z(i + o^) 
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for arbitrary fco > 1- Further, due to the fact that the functions are bounded, we obtain 
Sn,k{y) 


< E 
— 


( 


max - V \ {x{xi) - x{xi-i) + g{xi-i)) - (xivi) - xivi-i) + g{yi-i))\ 2i(l + 0 - 2 ) 

I n<i<n+k I ^^ 




l=ko 
I n+k 


< 


2(1 + I ^ \x{xi) - x{yi)\ + \x{xi-i) - x{yi-i)\ + \g{xi-i) - g{yi-i)\ j • 

\l=ko 


(43) 


Let us now evaluate 


Ex,y \x{xi) - x{yi)\ < ^Ex^y Plg{xi) - Ulg{yi)\ 

2 = 0 

oo « 

= ^ / \Ulg{u)-Ulg{v)\ ,^,...((x, y, 1), •)) {du x dv) 

i=o 

OO « 

= E / , \{9^Pl^u) - {g,Pld.)\ (n;,.nfC',-,^„„((x,y,i),-)) {du x dv) 


2 = 0 
oo 

E 

i=0 


1x2 


'{B{0,e)) 


[ g{z) 

JX2 


•) “ ^hi+u...,hi+P^ •) ) ’^"(dhi+i) ■ ■ ■ u^{dhi+i) 

X [U*^,UtC)^^^^^^J{x,y,l),-)) {du X dv) 

\g{zi) - g{z 2 )\ ((u,u, I),-)) {dzi x dz 2 ) 


OO 

sE 


i=Qj{me)YJX^ Jx2 
X (u*^,UtC^^^f,^^J{x,y,l),-)) {duxdv) iy%dhi+i)...iy%dhi+,). 

The appropriate properties of coupling measure we use (see condition (d) in Section 3.2) imply the 
following estimation 

Ex,y \x{xi) - x{yi)\ 


< 


OO n n 

E / / l5(^i)-5(22)1 fc2n;%i(7^;, ((x,y,l),-)) (d^i X dza) i^^(dhz+i)...i/^(d/i;+i). 

^ J(B{0,e)Y Jx2 V / 


i =0 J{B(0,e)) 

Hence, due to (I7|), we obtain 

00 « 

Ex,y \x{xi) - x{yi)\ < E / ■ C'G'g'+*(l + gx{x) + Qx{y)) u^dhi+i)... u^{dhi+i) 


< 


CG{1 + Qx{x) + Qx{y)) ^ q\ 


(44) 


i=l 


Simultaneously, 


Ex,y\g{xi-i) - g{yi-i)\ < CGq^ ^(1 + Qx{x) + Qx{y))- 


( 45 ) 
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Note that, thanks to (1441) and ()45l) . the expression (1431) may now be estimated by 

n+A: / oo oo \ 

2(1 + a‘^)CG{l + Qx{x) + Qxjy)) ^ 

l=ko \i=l i=l—l / 

n+A: / oo N 

< 4(1 + a‘^)CG{l + Qs:{x) + Qs{y)) I Y 

/=A:o \ ^=0 / 

4 rx+fc 


--(1 + a‘^)CG(l + Qs{x) + Qs{y)) Y^^ 

I — q .. 


The estimate is independent of (hj)j>i and therefore we obtain 


l=ko 


lim lim | 

n^oo k^oo 


i,k{^) - Hn,k{y)\ < Z -(1 + fT^)C'G(l + Qsi{x) + Qxiy)) Y ^' 

I — Q ^ 


l=ko 


Note that ko is arbitrary and therefore can be chosen so small that Yl^kg ^ close to zero as 
we wish. Then, lim^^oohm^-^oo \Hn,k{x) — Hn,k{y)\ = 0 for every x,y ^ X. The proof is complete. 

□ 


Lemma 9. Let cj^ > 0. Under Assumptions (I)-(VI), the square integrable martingale differenees 
(Zn)n>i satisfy conditions ^ and ilM . 

Proof. Let fi £ Note that 

OO OO OO 


n=l 


-2-5 


n=l 


n>l 


n=l 


Recall that sup„>]^ E^\Zn\^'^^ < oo (see (I25p l. On the other hand, by Lemma[6]we have s^/n —)• 
as n —>■ oo, which implies < oo and completes the proof of condition ([9]). 

To show condition (jlOl) . observe that 




n=l 


n=l 


\Zr 


12+5 


{dSr 


U+5 


< 79-1-^ sup < 


OO. 


n>l 


n=l 


□ 


C. Main result 

The CLT is verified for the generalised cell cycle model introduced and characterised in Section 
m (see Theorem 2, [l^i. Now, it is natural to ask for the proof of the LIL. 

Theorem 10. Let {X, g) be a Polish space and {xn)n>o o. Markov chain with state space X, transi¬ 
tion probability function He and initial distribution /i £ M^~^^{X). We assume conditions (I)-(VI), 
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which entail all properties described in Section ing If g is a Lipschitz function with = 0 and 

> 0, then Prob^-a.s. the sequence 

^ ^ Ta=i din) + {nt - k)g{xk+i) 

"■ ay/2n log log n 

for k < nt < k + 1, A: = l,...,n — 1, i>0, n > e, and 0n{t) = 0 otherwise, is relatively compact 
in C and the set of its limit points coincides with fC. 


Proof. We begin with the observation that, since s^/n —>■ > 0, as n —>■ oo (see Lemma ED , we 

obtain 


y/2sl log log 4 ^ ^ 
cr-v/SrHogTog^ ’ 


as n —)• oo. 


Hence, from Lemmas [8] and El it follows that the sequence 

Mfc + (4t-4)(4 

Vn{t) = - . - 

In log logn 

for si < s^t < k = 1,... ,n — 1 and f > 0, n > e, and gni'O = 0 otherwise, is relatively 

compact in C and the set of its limit points coincides with fC (see (8||). Let t G (0,1] and n > e. 
Now, if A: < nt < fe + 1, then 

ka"^ „2 / ^ {k + 1)0-2 ^2 

2 ^k+1- 


_^ ^ 

2 — 2 — 


’fc+1 


Set 


f/nit) ■■ = 


Mk + {nt - k)Zk+i 


ay/2n log log n ’ 
where A: > 1 is such that k < nt < k + 1. Since na‘^ js^ —>■ 1, as n 


(46) 


oo, we obtain 


(1 - e)sl < (1 + e)slt < (1 + 6)2(1 - e)-^sl^, 

for every e > 0 and n large enough. As a consequence, there is t* G [t(l —e)(l + e)“^, t(l + e)(l —e)“^] 
such that s| < On the other hand, the diameters of the intervals [sl/s^, foj- 

1 < A: < n — 1, converge to 0, as n —)• oo. Hence, there exists > 0 such that fin{t) = gn{in) and 
tn ^ t, as n ^ oo. Recall that the sequence {gn{i))n>e is relatively compact in C and the set of 
its limit points coincides with fC. Therefore, the sequence {'>)n{t))n>e is also relatively compact in C 
and has the same set of limit points. 

Fix 6 > 0 and define the set 


\Mn{u^)-T.lZl9{x^{u))\ 


Aji •— \ Cij G I 


> 


n 


u s G I 


\Zn{^) -g(x n(a;))| ^ £ 


n 


for n > 1. 


( 47 ) 
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Let us now show that Prob^(74„) < oo. Choose e > 0. Note that, by the Markov inequality 

and the fact that there is (5i > 0 such that < (2 + for Cj ? > 0, <5 € (0, (5i), 

we obtain 


\Mn{u^)-U=l9{x^{u;))\ 


Prob„ w G id : 


> 


= Prob,, ( a; G n 


n 


|x(xn(a;)) - x(xo(a;))| 

y/n 


> 


< , ^y E,\x{Xn)\^+^ + E,\x{xo)\^+^ 

-\e) ^ ^ ^ ni+V2 


Now, observe that, due to Lemma [3] 


nidx) 

JX 

< (2 + e)|x(x)l2+^ + (2 + 6) / |x(x) - x(x)|2+''Pr/i(dx) (48) 

Jx 

< (2 + e)|x(x)l2+^ + (2 + + (gl+^P^fi)). 


Note that the first component of (1481) is finite due to (IlSp and (I16p . while the second is finite due 
to Lemma [TJ Hence, 


\Mn{u^) - U=1 9ix^{u^))\ 


Prob^ cj G n 


> - < 


Cl 


n 


n 


1+5/2 ’ 


(49) 


where ci > is some constant independent of n. Similarly, 


Prob^ cj G n : 


\Zniuj) - g{xn{uj))\ i 


n 


> - [> = Prob^ <i n; G fd : 


|x(Xn+l(w)) - x{Xni(^))\ ^ £ 


n 


< 


C2 


n 


1+5/2 ’ 


(50) 


where C 2 > is some constant independent of n. By (j49|) and (I50p . the series Prob^(H„) is 

convergent. 

Finally, following the Borel-Cantelli Lemma, we obtain that Prob^-a.s. 

Mfc - (rad - k)Zk+i _ Ya=i 9{xi) + jnt - k)g{xk+i) ^ _ 
crV2nlog logn c7V2nlog logn ’ 

where k < nt < k + 1. This implies limsup„_^oo supQ<^<]^ |i?n(d) — 9n{t)\ < e. Since e > 0 was 
arbitrary, the proof is complete. □ 


limsup„^^supo<f<i 
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